On the optimal importance process for piecewise deterministic Markov process
نویسندگان
چکیده
منابع مشابه
Optimal Importance Sampling in Markov Process Simulation
In this paper we present an adaptive algorithm to estimate the transient blocking probability of a communication system, described by a Markov process, during a finite time interval starting from a given state. The method uses importance sampling for variance reduction and adjusts the parameters of the twisted distribution based on earlier samples. The method can be effectively applied to a dec...
متن کاملNumerical method for optimal stopping of piecewise deterministic Markov processes
We propose a numerical method to approximate the value function for the optimal stopping problem of a piecewise deterministic Markov process (PDMP). Our approach is based on quantization of the post jump location – inter-arrival time Markov chain naturally embedded in the PDMP, and path-adapted time discretization grids. It allows us to derive bounds for the convergence rate of the algorithm an...
متن کاملNumerical methods for optimal control of piecewise deterministic Markov processes
Scientific Research context: In 1980, M.H.A. Davis [1] introduced in probability theory Piecewise Deterministic Markov Processes (PDMP) as a general class of models suitable for formulating optimization problems in queuing and inventory systems, maintenance-replacement models, investment scheduling and many other areas of operation research. In the continuous-time context, stochastic control th...
متن کاملAveraging for a Fully-coupled Piecewise Deterministic Markov Process in Infinite Dimensions
In this paper, we consider the generalized Hodgkin-Huxley model introduced by Austin in [1]. This model describes the propagation of an action potential along the axon of a neuron at the scale of ion channels. Mathematically, this model is a fully-coupled Piecewise Deterministic Markov Process (PDMP) in infinite dimensions. We introduce two time scales in this model in considering that some ion...
متن کاملSimulating the formation of keratin lament networks by a piecewise-deterministic Markov process
Keratin intermediate lament networks are part of the cytoskeleton in epithelial cells. They were found to regulate viscoelastic properties and motility of cancer cells. Due to unique biochemical properties of keratin polymers, the knowledge of the mechanisms controlling keratin network formation is incomplete. A combination of deterministic and stochastic modeling techniques can be a valuable s...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ESAIM: Probability and Statistics
سال: 2019
ISSN: 1262-3318
DOI: 10.1051/ps/2019015